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TITLE OF THE INVENTION 



IMAGE PROCESSING APPARATUS AND METHOD, AND STORAGE 

MEDIUM THEREFOR 

5 

FIELD OF THE INVENTION 

This invention relates to an image processing 
apparatus and method for embedding access control 
10 information, which is watermark information, in a 
document image, and to a storage medium therefor. 

BACKGROUND OF THE INVENTION 

15 The image quality of images formed by digital image 

forming devices such as printers and copiers has been 
greatly improved in recent years and it is possible to 
use these devices to readily print high-quality images. 
The reduction in the cost of high-performance scanners, 

2 0 printers and copiers and image processing by computer 
have made it possible for anyone to obtain desired 
printed matter with facility. One consequence is the 
illegal copying of printed matter such as documents, 
images and photographs. In order to prevent or inhibit 

25 the unauthorized use of printed matter by such illegal 
copying, therefore, access control information in the 
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form of watermark information is embedded in the printed 
matter . 

The access control function generally is 
implemented by embedding access control information in 
5 printed matter in such a manner that it is not visible 
to the eye, by embedding a_ bitmap pattern (glyph code, 
DD code, etc.) , which corresponds to the access control 
information, in the margin of a document, or by 
scrambling the document image using code. Common 

10 methods of implementing the embedding of access control 
information in such a manner that it will be invisible 
to the eye include embedding the access control 
information by controlling the amount of space in an 
alphabetic character string; rotating characters and 

15 embedding the access control information in conformity 
with the amount of rotation; and enlarging or reducing 
characters and embedding the access control information 
in conformity with the enlargement or reduction rate. 
Fig. 21 is a diagram useful in describing an 

2 0 example in which access control information is embedded 
by controlling the amount of space between words in an 
alphabetic character string. Such a space is indicated 
at 1701 in Fig. 21. The space is made p A©(l+p) (p+s)/s, 
s A©(l-p) (p+2)/2 if a watermark bit to be embedded is 

25 "0" and is made p A©(l-p) (p+s) /2, s A©(l+p) (p+s) if a 
watermark bit to be embedded is "1". 



- 2 - 



a — * 



Figs. 22 and 23 are diagrams illustrating an 
example in which a character is rotated and access 
control information is embedded in conformity with the 
amount of rotation. Fig. 22 illustrates a character 
5 before it is rotated and Fig. 23 the character after it 
is rotated. The angle EA through which the character is 
rotated is indicated at 1901 in Fig. 23. 

Fig. 24 is a diagram illustrating an example in 
which access control information is embedded by 

10 enlarging or reducing a character. Numerals 2001 and 
2002 denote the original character width and the 
character width after reduction, respectively. The 
access control information is embedded in conformity 
with such enlargement or reduction. 

15 With these methods of embedding access control 

information, however, the original character or image is 
clearly deformed and the result is degradation of the 
original character or image. 

Further, with these methods of embedding access 

20 control information, it is necessary to read the printed 
matter with high precision and to read the amount of 
space between characters, the angle of rotation of a 
character or the size of a character in accurate fashion 
in order to detect the access control information that 

25 has been embedded. If printing is performed with a 
small character size and at a high resolution, 
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therefore, it is very difficult to detect the access 
control information that has been embedded in printed 
matter . 

5 SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is 
to provide an image processing apparatus, method and 
storage medium by which access control information can 

10 be embedded in an image without degrading the image. 

Another object of the present invention is to 
provide an image processing apparatus, method and 
storage medium by which access control information that 
has been embedded can be read with high precision. 

15 In order to achieve the above objects, an image 

processing apparatus of the present invention comprises: 
image input means for inputting an image; extraction 
means for extracting an outline of the image that has 
been input by the image input means; vector generating 

2 0 means for generating vector information conforming to 

state of pixels neighboring each pixel constituting the 
output that has been extracted by the extraction means; 
and embedding means for altering the image in accordance 
with watermark information and embedding the watermark 

25 information on the basis of the vector information. 

In order to achieve the above objects, an image 
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processing method of the present invention comprises: 
an image input step of inputting an image; an 
extraction step of extracting an outline of the image 
that has been input at the image input step; a vector 
generating step of generating vector information 
conforming to state of pixels neighboring each pixel . 
constituting the output that has been extracted at the 
extraction step; and an embedding step of altering the 
image in accordance with watermark information and 
embedding the watermark information on the basis of the 
vector information. 

In order to achieve the above objects, an image 
processing apparatus of the present invention comprises: 
arithmetic means for obtaining an average of pattern 
scores of a target binary image based upon the target 
binary image and first principal component values of a 
reference pattern; comparison means for comparing the 
average of pattern scores of the target binary image and 
a reference-pattern score that is based upon a sum total 
of distances between a first principal component 
direction of the reference pattern and a standard 
vector; translation means for translating feature 
vector space of the target binary image in accordance 
with result of the comparison by said comparison means 
and access control information to be embedded in the 
target binary image; and altering means for altering the 



target binary image based upon a result obtained by 
translating the feature vector space. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction .with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principle of 
the invention. 

Fig. 1 is a diagram useful in describing the flow 
of a conversion of document image data according to an 
embodiment of the present invention; 

Fig. 2 is a diagram illustrating the flow of image 
data with regard to reading of access control 
information by a scanner; 

Fig. 3 is a diagram illustrating an example of an 
observation image (document image) of M x N pixels 
according to this embodiment; 



Fig. 4 is a diagram illustrating an example of an 
outline image in which the outline of the observation 
image of Fig. 3 is indicated by one pixel width; 

Fig. 5 is a diagram useful in describing features 
5 of direction indices of a pixel of interest; 

Fig. 6 is a diagram illustrating variates, and the 
values thereof, of the features of the direction indices 
of the pixel of interest; 

Fig. 7 is a diagram in which the variates of the 
10 features of the direction indices in Fig. 6 are 
expressed by a feature vector; 

Fig. 8 is a diagram illustrating an example of the 
image of a standard vector; 

Fig. 9 is a diagram useful in describing the 
15 features of the direction indices of the standard vector 
shown in Fig. 8; 

Fig. 10 is a diagram illustrating an example of a 
reference image composed of S x T pixels; 

Fig. 11 is a diagram illustrating an example of an 
20 outline image in which the outline of the reference 

image of Fig. 10 is made a fine line of one pixel width; 

Fig. 12 is a diagram illustrating an example of a 
bit sequence of access control information; 

Fig. 13 is a flowchart illustrating processing, 
25 which is executed by an image processing apparatus 
according to a first embodiment of the present 
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invention, for embedding access control information in a 
document image; 

Fig. 14 is a flowchart illustrating processing, 
which is executed by the image processing apparatus 
5 according to the first embodiment, for embedding access 
control information in a document image; 

Fig. 15 is a conceptual view illustrating an 
example wherein a first principal component vector is 
obtained from the feature vector space of a reference 
10 pattern, and the feature vector space of a document 
image (observation image) , in which watermark 
information is to be embedded, is altered in accordance 
with the watermark information according to the first 
embodiment ; 

15 Fig. 16 is a diagram illustrating an example in 

which a document image has been divided into blocks ; 

Fig. 17 is a diagram useful in describing an 
example in which a bit sequence of access control 
information and a random-number sequence have been 

20 assigned to the blocks obtained by division in Fig. 16; 
Fig. 18 is a block diagram illustrating the 
hardware implementation of an image processing apparatus 
according to the first to fourth embodiments of the 
present invention; 

25 Fig. 19 is a flowchart illustrating processing for 

extracting access control information, which has been 
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embedded in an image,, from the printed image according 
to the first embodiment ; 

Fig. 20 is a flowchart illustrating processing for 
extracting access control information, which has been 
5 embedded in an image, from the printed image according 
to the first embodiment; 

Fig. 21 is a diagram useful in describing an 
example in which control information is embedded by 
controlling the amount of space between words; 
10 Fig. 22 is a diagram showing a character before it 

is rotated; 

Fig. 23 is a diagram useful in describing 
processing for embedding control information by rotating 
a character; 

15 Fig. 24 is a diagram useful in describing an 

example in which control information is embedded by 

enlarging or reducing a character; 

Fig. 25 is a flowchart illustrating processing, 

which is executed by an image processing apparatus 
2 0 according to a second embodiment of the present 

invention, for embedding access control information in a 

document image; 

Fig. 2 6 is a flowchart illustrating processing, 

which is executed by the image processing apparatus 
2 5 according to the second embodiment, for embedding access 

control information in a document image; 
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Fig. 27 is a flowchart illustrating processing for 
extracting access control information, which has been 
embedded in an image, from the printed image; 

Fig. 28 is a flowchart illustrating processing for 
5 extracting access control information, which has been 
embedded in an image, from the printed. image ; 

Fig. 2 9 is a functional block diagram illustrating 
the functional construction of the image processing 
apparatus according to the second embodiment ; 
10 Fig. 30 is a flowchart illustrating processing, 

which is executed by an image processing apparatus 
according to a third embodiment of the present 
invention, for embedding access control information in a 
document image; 
15 Fig. 31 is a flowchart illustrating processing, 

which is executed by the image processing apparatus 
according to the third embodiment, for embedding access 
control information in a document image ; 

Fig. 32 is a conceptual view useful in describing 
20 the Mahalanobis distance (MD1 ) between the feature 
vector space of a reference pattern and a standard 
vector, and the Mahalanobis distance (MD2) between the 
feature vector of an observation pattern and the 
standard vector; 
25 Fig. 33 is a flowchart illustrating processing for 

extracting access control information, which has been 
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embedded in an image, from the printed image in the 
third embodiment; 

Fig. 34 is a flowchart illustrating processing for 
extracting access control information, which has been 
embedded in an image, from the printed image in the 
third embodiment; 

Fig. 35 is a diagram illustrating variates, and the 
values thereof, of the features of the direction indices 
of the pixel of interest in a fourth embodiment ; 

Fig. 36 is a diagram in which the variates of the 
features of the direction indices in Fig. 35 are 
expressed by a feature vector of direction indices; 

Fig. 37 is a diagram useful in describing the 
features of the direction indices of the standard vector 
shown in Fig. 8 in the fourth embodiment of the present 
invention; 

Fig. 38 is a diagram illustrating an example of an 
observation image (document image) of M x N pixels; 

Fig. 3 9 is a diagram illustrating an example of an 
outline image in which the outline of the observation 
image of Fig. 38 is indicated by one pixel; 

Fig. 4 0 is a diagram useful in describing the 
features of the direction indices of a pixel of 
interest ; 
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Fig. 41 is a diagram illustrating variates, and the 
values thereof, of the features of the direction indices 
of the pixel of interest in the fourth embodiment; 

Fig. 42 is a diagram in which the variates of the 
5 features of the direction indices in Fig. 41 are 

expressed by a feature vector of direction indices; 

Fig. 43 is a diagram illustrating an example of the 
image of a standard vector according to the fourth 
embodiment ; 

10 Fig. 44 is a diagram useful in describing the 

features of the direction indices of the standard vector 
shown in Fig. 4 3 in the fourth embodiment ; 

Fig. 45 is a flowchart illustrating processing, 
which is executed by an image processing apparatus 

15 according to the fourth embodiment, for embedding access 
control information in a document image; 

Fig. 46 is a flowchart illustrating processing, 
which is executed by an image processing apparatus 
according to the fourth embodiment, for embedding access 

2 0 control information in a document image; 

Fig. 47 is a flowchart illustrating processing for 
extracting access control information, which has been 
embedded in an image, from the printed image according 
to the fourth embodiment; and 

25 Fig. 48 is a flowchart illustrating processing for 

extracting access control information, which has been 
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embedded in an image, from the printed image according 
to the fourth embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

Preferred embodiments of the present invention will 
now be described with reference to the accompanying 
drawings. Though the following embodiments are 
described taking a monochrome laser-beam printer 
10 (referred to simply as a monochrome LBP below) as an 

example, the present invention is not limited to such an 
example and may be applied also to other printers such 
as ink- jet printer, by way of example. 

Here a document image is assumed to be a binary 
15 black-and-white image, and a low-cost scanner is used as 
an image reader for reading printing manner. 
[First Embodiment] 

Fig. 1 is a diagram useful in describing the flow 
of a conversion of document image data in a monochrome 

2 0 LBP according to a first embodiment of the present 

invention relating to the embedding of access control 
information. Here image data representing a document is 
delivered to the printer driver of a monochrome LBP as 
binary image data 101. Next, the binary image data 101 

25 is converted to device binary image data 102 that 

conforms to the characteristic of the printer, then the 
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device binary image data 102 is decomposed into 
multilevel K- image data 103. The latter is then 
binarized to binary K- image data 104. 

The binary K-image data 104 is delivered to a 
5 printer engine and is printed on paper or the like at a 
high resolution. . - 

Fig. 2 is a diagram illustrating the flow of a 
conversion of image data with regard to reading of 
access control information by a scanner according to the 
10 first embodiment of the present invention. In Fig. 2, 
image data obtained by the scanner which reads a 
document is supplied to a scanner driver as multi-value 
of grayscale image data 201. 

Feature space of an observation pattern, a standard 
15 vector and feature space of a reference pattern 

according to this embodiment will now be described. 

Fig. 3 is a diagram illustrating an example of an 
image of M x N pixels corresponding to part of the 
binary K-image data 104, and Fig. 4 is a diagram 
20 illustrating an example of an outline image in which the 
outline of the observation image of Fig. 3 is extracted 
and made a fine line of one pixel width. 

Fig. 5 is a diagram illustrating direction indices 
for extracting the features of a pixel of interest Pij 
25 in a case where the pixel of interest is located at the 
center of a 3 x 3 pixel block. Fig. 5 illustrates a 
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case where pixels exist in directions tl, t2, t3, t8 of 
the pixel of interest but not in directions t4, t5, t6, 
t7 of the pixel of interest. 

Fig. 6 illustrates values corresponding to the 
5 features tl, t2, t3, t4, t5, t6, t7 and t8 of the 

direction indices of the pixel of interest shown in Fig. 
5. Here a "1" indicates the presence of a pixel in the 
direction of the corresponding direction index and a "0" 
the absence of a pixel in the direction of the 

10 corresponding direction index. 

Fig. 7 illustrates vectorization of the features 
{see Fig. 6) of the direction indices of the pixel of 
interest Pij shown in Fig. 5. Here the feature vector 
Hij of the direction indices is a vector of the features 

15 of the direction indices of the pixel of interest Pij . 
This vector has eight dimensions. The feature space of 
the observation pattern is a set of the feature vectors 
of the direction indices of each pixel of the outline 
image shown in Fig. 4. The feature space of the 

20 observation pattern has eight dimensions. 

Fig. 8 illustrates a standard-vector pattern. The 
standard vector of this standard-vector pattern 
represents the features of the direction indices of the 
pattern. Fig. 9 illustrates a vector DIST indicating 

25 the features of these direction indices. 

Fig. 10 is a diagram showing an example of a 
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reference image composed of S x T pixels, and Fig. 11 
illustrates the outline image of this image. The 
feature space of the reference pattern is a set of 
feature vectors of direction indices of each of the 
5 pixels in the outline image. The feature space of the 
reference pattern has eight dimensions. 

A procedure for embedding access control 
information in a document image will be illustrated 
next . 

10 Fig. 12 is a diagram illustrating an example of a 

bit sequence of access control information (watermark 
information) . Numerals 1201 and 1202 indicate "0" and 
"1" bits, respectively. 

Figs. 13 and 14 are flowcharts illustrating 

15 processing for embedding access control information 
(watermark information) in a document image for the 
purpose of accessing the document image. Operation will 
be described with reference to these flowcharts. 

The score of a reference pattern is calculated from 

2 0 a standard vector and a first principal component of the 
reference pattern at step SI. This is found on the 
basis of the following equation (1) : 

zl* = all-xl* + al2-x2* + ••• + al8-x8* ... Eq. (1) 
where zl* represents the reference-pattern score, all, 

25 • • • , al8 represent the component values of a first 

principal component vector of the reference pattern, and 
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xl*, x8* represent the component values of the 

standardized standard vector. It should be noted that 
all, •••/ al8 are assumed to be eigenvectors of a 
correlation matrix of standard vector components xl, 
5 • • • , x8 . In a case where a standard vector and a 

reference pattern have already been decided, the score 
of this reference pattern may be calculated and stored 
in a memory or the like beforehand. 

Fig. 15 is a conceptual view illustrating an 

10 example wherein a first principal component vector is 
obtained from the feature vector space of a reference 
pattern, and the feature vector space of a document 
image (observation image) , which is the target image in 
which watermark information is to be embedded, is 

15 altered in accordance with the watermark information. 

Numerals 1500 and 1503 in Fig. 15 denote the 
feature vector space of a reference pattern and the 
first principal component vector of this reference 
pattern, respectively. Accordingly, the score zl* of 

20 this reference pattern corresponds to the sum total of 

the linear distances between the components of the first 
principal component vector and the components of the 
standard vector. 

Next, at step S2 in Fig. 13, the document image 

25 corresponding to the binary K-image data 104 of Fig. 1 
is read in. Control then proceeds to step S3, at which 
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the document image that was read in at step S2 is 
divided into blocks. Numerals 1601, 1602 and 1603 in 
Fig. 16 denote a block of M x N pixels, a row-number 
index of each block and a column-number index of each 
5 block, respectively. The index number in Fig. 16 is an 
m x n matrix. An index vector of m x -n -dimensions 
corresponding to the blocks is generated based upon the 
index matrix. Element numbers of the index vector are 
the index numbers of the blocks 1601. 

10 Next, at step S4, random numbers from "1" to "m x 

n" are generated based upon key information decided in 
advance or entered by the user. The generated random 
numbers correspond to element numbers of the index 
vector generated at step S3. In other words, each 

15 random-number value corresponds to the index number of a 
block. 

This is followed by step S5, at which the bit 
sequence (8-bit data) of the access control information 
shown in Fig. 12 and the index numbers of the blocks are 

20 made to correspond. When this mapping reaches the end 
of the bit sequence (the eighth bit in the example of 
Fig. 12), the mapping of the next block starts from the 
beginning (the first bit) of this bit sequence. This 
bit sequence is thus assigned repeatedly until all 

25 blocks are assigned bits of the bit sequence. 

Fig. 17 illustrates an example of correspondence 
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among a bit sequence 1701, which is watermark 
information, a random-number sequence 1702 generated at 
step S4 and the index number of each block. 

Reference numerals 1701 and 1702 in Fig. 17 
5 represent a bit sequence and a random-number sequence 

corresponding thereto, respectively. The number of bits 
in the bit sequences 17 01 and the number of random 
numbers (Rl to Rmn) , which are also the index numbers of 
the respective blocks, are both m x n. Further, the 

10 random number Rl in Fig. 17 corresponds to the block of 
index number (I, J) = (1,1), the random number R2 
corresponds to the block of index number (I, J) = (1,2) 
and, in similar fashion, the final random number Rmn 
corresponds to the block of index number (I, J) = (m,n). 

15 Next, at step S6, it is determined whether random- 

number sequences up to the (m x n) th random-number 
sequence have been checked. If the (m x n) th random- 
number sequence has not yet been checked, control 
proceeds to step S7, at which the index number of the 

20 block [I, J = (1,1)] corresponding to the Xth (1 st ) random 
number (random number Rl in Fig. 17) of the random- 
number sequence 1702, as well as the value ("0" in the 
example of Fig. 17) of the bit of bit sequence 1701 that 
corresponds to this index number, is acquired. Control 

25 then proceeds to step S8, at which the (M x N) -pixel 
block of the document image corresponding to the 
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acquired index number is acquired. This is followed by 
step S9 (Fig. 14). This step is for calculating the 
average of the observation-pattern scores, which 
prevails when the obtained (M x N) -pixel document image 
5 is adopted as the observation image, based upon the 
first principal component values of the reference- 
pattern that was calculated at step SI. This is found 
on the basis of the following equation: 

zzl* = (all-ill* + al2-u2* + ••• + al8-u8*)/p ...Eq. (2) 

10 where zzl* represents the average of the observation- 
pattern score, all, al8 represent the first 
principal component values of the reference pattern, 
ul*, u8* represent the component values of the 
feature space of the standardized observation pattern, 

15 and p denotes the number of observation points in the 

feature space of the observation pattern. For example, 
p indicates the number of outline points of the outline 
image shown in Fig. 4. 

Control then proceeds to step S10, at which it is 

20 determined whether the bit of the bit sequence 1701 that 
corresponds to this block is "0". If the bit is "0", 
control proceeds to step Sll, at which the entire 
feature space of the observation pattern is moved so as 
to establish the following relation: 

25 zzl* > zl* (observation-pattern score) + defZ 

If the bit of bit sequence 1701 corresponding to 
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this block is found to be "1" at step S10, control 
proceeds to step S13, at which the entire feature space 
of the observation pattern is moved so as to establish 
the following relation: 
5 zzl* < zl* (observation-pattern score) + defZ 

where defZ is a prescribed value set in advance. 

In Fig. 15, the feature vector space of the 
observation pattern is indicated at 1501. Reference 
number 1502 denotes the feature space of the observation 

10 pattern that was moved at step Sll or S13. At the time 
of such movement, the shift is made in a direction in 
which there is an increase in the values of the elements 
of all feature vectors in the feature space of the 
observation pattern; there is no movement in a direction 

15 in which the values of these elements decrease. 

Control proceeds from step Sll and S13 to step S12, 
at which the image data representing the observation 
image is reconstructed based upon the feature space of 
the observation pattern after the feature space of the 

2 0 observation pattern has been moved. The above is 

executed until random-number sequences no longer exist 
at step S6, i.e., until processing corresponding to the 
(m x n) th random number is completed. 

The binary K-image data thus obtained is output to 

25 the printer engine as the binary K-image data 104 of 
Fig. 1 and is printed by the printer. 
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Fig. 18 is a block diagram illustrating the 
hardware implementation of an image processing apparatus 
according to this embodiment of the present invention. 
As shown in Fig. 18, the apparatus includes an 
5 image input unit 110 for inputting image information. 
The image input unit 110 may be a scanner, for example, 
or have a memory device into which a storage medium such 
as a CD-ROM is inserted and from which the stored image 
data is input,. The image data may be loaded from an 

10 external storage device 115 (described later) or may be 
entered from another network via a line interface (I/F) 
117. A CPU 111 controls the overall operation of the 
apparatus and executes a program (indicated, for 
example, by the flowcharts of Figs. 13 and 14) that has 

15 been stored in a memory 112. The latter stores 

temporarily image data used in the above-described 
processing, stores random numbers, vector information 
and index information, etc., that has been input and/or 
generated, and is used as a work area for storing 

20 various data when processing is executed by the CPU 111. 
An input unit 113 has a keyboard and a pointing device 
such as a mouse. The input unit 113 is operated by an 
operator to order the generation of the random numbers 
and to enter various control information. 

25 A display 114 has a CRT or a liquid crystal panel, 

etc. The external storage device 115, which has a 
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storage medium such as a hard disk or magneto- optic 
disk, stores various image data and programs, etc. A 
printer 116 is a laser printer in this embodiment, as 
mentioned earlier, though the present invention is not 
limited to a laser printer and may be applied also to an 
ink- jet printer or the like. The line interface 117 
controls communication with another device or network 
via a communication line. 

Described next will be a case where access control 
information (watermark information) is extracted from an 
image in which an electronic watermark has been embedded 
in the manner described above. 

Figs. 19 and 20 are flowcharts illustrating 
processing for extracting access control information 
from a printed image. The program for executing this 
processing has been stored in the memory 112 and is 
executed under the control of the CPU 111. 

In a manner similar to that of step SI in Fig. 13 
described above, a step S21 calls for the calculation of 
a reference-pattern score from a standard vector and the 
first principal component of a reference pattern. 
Control then proceeds to step S22, at which the scanner 
of the image input unit 110 is used to read the printed 
image in a grayscale mode (8 bits/pixel) . This is 
followed by step S23, at which the outline of the read 
image is extracted and an outline image in which the 



outline portion is made a fine line of one pixel, as 
shown in Fig. 4, for example, is generated. Next, at 
step S24, the outline image is converted to a size that 
prevailed when the access control information was added 
5 on. The outline image obtained by the conversion is 
then subjected to the processing set forth below. It 
should be noted that the processing of steps S26 to S30 
in Figs. 19 and 20 is the same as that of step S4 and 
steps S6 to S9 in Figs. 13 and 14 described above. 

10 First, at step S25, the outline image is divided 

into (M x N) -pixel blocks and an m x n index matrix is 
generated from the row-number indices and column-number 
indices of the respective blocks, as shown in Fig. 16. 
An index vector of m X n dimensions is then generated 

15 from the index matrix. The element numbers of the index 
vector are the index numbers of the respective blocks. 

Control then proceeds to step S26, at which 1 to 
m x n random numbers are generated based upon key- 
information decided in advance or entered by the user. 

2 0 The generated random numbers correspond to the element 
numbers of the index vector generated at step S25. In 
other words, each random-number value corresponds to the 
index number of a block. Next, at step S27, it is 
determined whether a random-number seguence still 

25 exists, i.e., whether the processing of all blocks has 
been completed. If processing has not been completed 
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for all blocks, control proceeds to step S28, at which 
the index number of the block corresponding to the Xth 
(1 st ) random number (random number Rl) is acquired. This 
is followed by step S2 9, at which the (M x N) -pixel 
5 outline image corresponding to the index number of the 
acquired block is obtained. Control then proceeds to 
step S30. This step is for calculating the average of 
the observation-pattern scores, which prevails when the 
obtained (M x N) -pixel document image^ is adopted as the 

10 observation image, based upon the first principal 
component score of the reference-pattern that was 
calculated at step S21. This can be found in accordance 
with Equation (2) cited above. 

Next, control proceeds to step S31, at which the 

15 degree of similarity (g) between the reference-pattern 
score (zl*) and the average (zzl*) of the observation- 
pattern scores thus obtained is calculated. The degree 
of similarity (g) at this time is calculated in 
accordance with the following equation: 

20 g = zzl* - zl* 

Next, at step S32, the calculated similarity (g) 
and a predetermined value (defZ) are compared. If 
g > defZ holds, control proceeds to step S33 and it is 
decided that the embedded bit is "0". If it is found 

25 that g > defZ does not hold at step S32, then control 
proceeds to step S34, at which it is decided that the 
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embedded bit is "1". Control returns to step S27 after 
step S33 or step S34 is executed. The processing of 
steps S28 to S34 is executed repeatedly until the above- 
described processing is applied to the (ra x n) th random 
5 number. Thus, a number of decisions are rendered on the 
basis of the extracted bit sequence and- the bit length 
that prevailed when the access control information was 
embedded is reproduced. 

Thus, in accordance with the first embodiment as 
10 described above, desired control information can be 

embedded without degrading the image that receives the 
embedded information. 

Further, control information that has been embedded 
in an image can be read and detected with high 
15 precision. 

[Second Embodiment] 

Figs. 25 and 26 are flowcharts illustrating 
processing for embedding access control information 
(watermark information) in a document image for the 
20 purpose of accessing the document image. Operation will 
be described with reference to these flowcharts. 

A reference-pattern vector is generated from the 
standard vector (see Fig. 9) and a reference-pattern 
center vector. The reference-pattern center vector 
25 (center) is found in accordance with Equation (3) below, 
center = ul/V(xl) ... Eq. (3) 
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where xl represents a variance vector of the reference- 
pattern feature space, ul is the average vector of the 
reference-pattern feature space and "center" denotes the 
center vector of the reference pattern. 

Next, at step S42 in Fig. 25, the document image 
corresponding to the binary K-image data 104 of Fig. 1 
is read in. Control then proceeds to step S43, at which 
the document image that was read in at step S2 is 
divided into blocks in the manner shown in Fig. 16. 
Numerals 1601, 1602 and 1603 in Fig. 16 denote a block 
of M x N pixels, a row-number index of each block and a 
column-number index of each block, respectively. The 
index number in Fig. 16 is an m x n matrix. An index 
vector of m x n dimensions corresponding to the blocks 
is generated based upon the index matrix. Element 
numbers of the index vector are the index numbers of the 
blocks 1601. 

Next, at step S44, random numbers from "1" to 
"m x n" are generated based upon key information 
decided in advance or entered by the user. The 
generated random numbers correspond to element numbers 
of the index vector generated at step S43. In other 
words, each random-number value corresponds to the index 
number of a block. 

This is followed by step S45, at which the bit 
sequence (8-bit data) of the access control information 
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shown in Fig. 12 and the index numbers of the blocks are 
made to correspond. When this mapping reaches the end 
of the bit sequence (the eighth bit in the example of 
Fig. 12), the mapping of the next block starts from the 
5 beginning (the first bit) of this bit sequence. This 
bit sequence is thus assigned repeatedly until all 
blocks are assigned bits of the bit sequence. 

Fig. 17 illustrates an example of correspondence 
among the bit sequence 1701, which is watermark 

10 information, the random-number sequence 1702 generated 
at step S4 4 and the index number of each block. 

Reference numerals 1701 and 1702 in Fig. 17 
represent the bit sequence and the random-number 
sequence corresponding thereto, respectively. The 

15 number of bits in the bit sequence 1701 and the number 
of random numbers (Rl to Rmn) , which are also the index 
numbers of the respective blocks, are both m x n. 
Further, the random number Rl in Fig. 17 corresponds to 
the block of index number (I, J) = (1,1), the random 

2 0 number R2 corresponds to the block of index number (I, J) 
= (1,2) and, in similar fashion, the final random number 
Rmn corresponds to the block of index number (I, J) = 
(m,n) . 

Control proceeds to step S4 6. Next, the index 
25 number of the block [I, J = (1,1)] corresponding to the 

Xth (1 st ) random number (random number Rl in Fig. 17) of 
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the random-number sequence 1702, as well as the value 
("0" in the example of Fig. 17) of the bit of bit 
sequence 17 01 that corresponds to this index number, is 
acquired (step S47) . Control then proceeds to step S48, 
5 at which the (M x N) -pixel block of the document image 
(the block I = J = 1 in Fig. 16) corresponding to the 
acquired index number is acquired. This is followed by 
step S49 (Fig. 26) . This step is for generating an 
observation-pattern vector from an observation-pattern 

10 center vector of the feature space of an observation 
pattern when the obtained M X N document image is 
adopted as an observation image, and the standard 
vector. The observation-pattern center vector is found 
in accordance with Equation (4) below. 

15 center = u2/V(x2) ... Eq. (4) 

where x2 represents a variance vector of the 
observation-pattern feature space, u2 is the average 
vector of the observation-pattern feature space and 
"center" denotes the center vector of the reference 

20 pattern. 

Control then proceeds to step S50, at which a 
correlation coefficient (r) between the reference- 
pattern vector generated at step S41 and the 
observation-pattern vector generated at step S49 is 

25 calculated. 

Next, at step S51, it is determined whether the bit 
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of the bit sequence 1701 that corresponds to this block 
is "0". If the bit is "0", control proceeds to step 
S52, at which the entire feature space of the 
observation pattern is moved so as to establish the 
5 following relation: 

-def < r < def . - 

If the bit of bit sequence 17 01 corresponding to 
this block is found to be "1" at step S50, control 
proceeds to step S54, at which the entire feature space 

10 of the observation pattern is moved so as to establish 
the following relation: 

-1 < r < -def or def < r < 1 
where "def" represents a value that is set is advance 
and 0 < def < 1 holds. 

15 Movement of the feature space at steps S52 and S54 

is made in a direction in which there is an increase in 
the values of the elements of all feature vectors in the 
feature space of the observation pattern; there is no 
movement in a direction in which the values of these 

20 elements decrease. 

Control proceeds from step S52 and S54 to step S53, 
at which the image data representing the observation 
image (the document image) is reconstructed based upon 
the feature space of the observation pattern after the 

25 feature space of the observation pattern has been moved. 
The above is executed until random-number sequences no 
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longer exist at step S46, i.e., until processing 
corresponding to the (m x n) th random number is 
completed. 

The binary K-image data thus obtained is output to 
5 the printer engine as the binary K-image data 104 of 
Fig. 1 and is printed by the printer. 

It should be noted that the hardware implementation 
of the image processing apparatus according to the 
second embodiment is identical with that of Fig. 18 and 
10 need not be described again. 

Described next will be a case where access control 
information (watermark information) is extracted from an 
image in which an electronic watermark has been embedded 
in the manner described above. 
15 Figs. 27 and 28 are flowcharts illustrating 

processing for extracting access control information 
from an image printed upon having the watermark 
information embedded therein. The program for executing 
this processing has been stored in the memory 112 and is 
20 executed under the control of the CPU 111. 

In a manner similar to that of step S41 in Fig. 25 
described above, a step S61 calls for the generation of 
a reference-pattern vector from a standard vector and 
reference-pattern center vector. The reference-pattern 
25 center vector is in accordance with Equation (3) above. 
Control then proceeds to step S62, at which the scanner 
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of the image input unit 110 is used to read the printed 
image in a grayscale mode (8 bits/pixel) . This is 
followed by step S63, at which the outline of the read 
image is extracted and an outline image in which the 
5 outline portion is made a fine line of one pixel width, 
as shown in Fig. 4, for example, is generated. Next, at 
step S64, the outline image is converted to a size that 
prevailed when the access control information was added 
on. The outline image obtained by the conversion is 

10 then subjected to the processing set forth below. It 

should be noted that the processing of steps S65 to S70 
in Figs. 27 and 28 is basically the same as that of step 
S44 and steps S46 to S49 in Figs. 25 and 26 described 
above. At step S68, however, only the index number of 

15 the block corresponding to the Xth random number of the 
random-number sequence is extracted. This processing 
differs from that of step S47 in Fig. 25. 

More specifically, at step S65, the outline image 
is divided into (M x N) -pixel blocks and an m x n index 

20 matrix is generated from the row-number indices and 

column-number indices of the respective blocks, as shown 
in Fig. 16. An index vector of m x n dimensions is then 
generated from the index matrix. The element numbers of 
the index vector are the index numbers of the respective 

25 blocks. 

Control then proceeds to step S66, at which 1 to 
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m x n random numbers are generated based upon key 
information decided in advance or entered by the user. 
The generated random numbers correspond to the element 
numbers of the index vector generated at step S65. In 
5 other words, each random-number value corresponds to the 
index number of a block. Next, at step S67, it is 
determined whether a random-number sequence still 
exists, i.e., whether the processing of all blocks has 
been completed. If processing has not Joeen completed 

10 for all blocks, control proceeds to step S68, at which 
the index number of the block corresponding to the Xth 
(1 st ) random number (random number Rl) is acquired. This 
is followed by step S69, at which the (M x N) -pixel 
outline image corresponding to the index number of the 

15 acquired block is obtained. Control then proceeds to 
step S70 (Fig. 28) . This step is for generating an 
observation-pattern vector from an observation-pattern 
center vector of the feature space of an observation 
pattern when the obtained (M x N) -pixel document image 

2 0 is adopted as an observation image, and the standard 

vector. The observation-pattern center vector is found 
in accordance with Equation (4) cited above. 

Control then proceeds to step S71, at which a 
correlation coefficient (r') between the reference- 

25 pattern vector thus obtained and the observation-pattern 
Is calculated. The correlation coefficient (r 1 ) and a 
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predetermined value are compared at step S72. If the 
following relation: 

-def < r' < def 
holds, control proceeds to step S73 and it is decided 
5 that the embedded bit is "0". If it is found that the 
above relation does not hold at step S72, then control 
proceeds to step S74 and it is decided that the embedded 
bit is "1". Here "def" is a value set in advance and it 
is assumed that 0 < def ^ 1 holds. 

10 Control returns to step S67 after step S73 or step 

S74 is executed. The processing of steps S68 to S74 is 
executed repeatedly until the above-described processing 
is applied to the (m x n) th random number (Rmn) . Thus, 
a number of decisions are rendered on the basis of the 

15 extracted bit sequence and the bit length that prevailed 
when the access control information was embedded is 
reconstructed. 

Fig. 29 is a functional block diagram illustrating 
the functional construction of the image processing 

2 0 apparatus according to the second embodiment of the 
present invention. 

As shown in Fig. 29, the apparatus includes a 
reference-pattern vector generator 210 for generating a 
reference-pattern vector based upon the standard vector 

2 5 of Fig. 9 and the center vector [indicated by Equation 
(3) ] of the reference pattern shown in Fig. 11, by way 
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of example. An input-image division unit 211 divides 
the outline image (e.g., Fig. 4) of the image, which has 
been read by a scanner or the like, into a plurality of 
blocks, represents each block by an index and assigns 
5 each bit of access control information, which has been 
input from a watermark-bit input unit 212, to each 
block. The apparatus further includes a unit 213 for 
generating an observation-pattern vector of an image 
block. Specifically, on the basis of the center vector 

10 of an outline pattern (observation pattern) of a certain 
image block and a standard vector, the unit 213 
generates the vector of this observation pattern. A 
correlation-coefficient calculation unit 214 finds a 
correlation coefficient between the reference-pattern 

15 vector found by the reference-pattern vector generator 

210 and the observation-pattern vector found by the unit 
213. A unit 215 moves the feature space of the 
observation pattern. Specifically, if the value of a 
bit of the access control information to be embedded in 

2 0 the image block is "0", the unit 215 moves the feature 
space of the observation pattern in such a manner that 
the correlation coefficient r between the reference- 
pattern vector and the observation-pattern vector will 
satisfy the relation — def < r < def . If the value of 

25 the bit is "1", the unit 215 moves the feature space of 
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the observation pattern in such a manner that the 
correlation coefficient r will satisfy the relation 
-1 < r ^ -def or def < r < 1. A printer unit 216 prints 
the observation pattern which has been modified on the 
5 basis of the observation pattern vector whose the 

feature space of the observation pattern has been moved. 
The above description shows a flow of processing for 
printing an image which embeds the access control 
information into input image data. 

10 Next, the description for reading a document image 

embedding access information and extracting the access 
information will be explained. The input-image division 
unit 211 reads the printed document image and extracts 
an outline image of the document image and divides the 

15 outline image into a plurality of blocks. The 

observation pattern vector generation unit 213 acquires 
the vector of this observation pattern of the document 
image. The correlation-coefficient calculation unit 214 
calculates a correlation coefficient r' between the 

20 reference-pattern vector and the observation-pattern 

vector found by the unit 213. A bit discriminator 217 
determines that the embedded bit is "0" if the 
correlation coefficient r' satisfies with the condition 
of -def < r' < def, alternatively, the embedded bit is 

25 "1" if the correlation coefficient r' does not satisfy. 
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The access control information that has been embedded in 
an image can thus be extracted. 

Thus, in accordance with the second embodiment, as 
described above, desired control information can be 
5 embedded in an image without the degrading the image. 

Further, control information that has been embedded 
in an image can be read and detected with high 
precision. 

[Third Embodiment] 

10 Figs. 30 and 31 are flowcharts illustrating 

processing for embedding access control information 
(watermark information) in a document image for the 
purpose of accessing the document image. Operation will 
be described with reference to these flowcharts. 

15 First, at step S81, a Mahalanobis distance (MD1) 

between the feature space of a reference pattern and a 
standard vector is calculated. This performed in 
accordance with Equation (5) below. 

D2 = (x-u) ' £ -1 (x-u) ... Eg. (5) 

20 where x represents the standard vector, u denotes the 
average vector of the reference-pattern feature space, 
XT 1 denotes the inverse matrix of a covariance matrix of 
the reference-pattern feature space and D2 denotes the 
Mahalanobis distance (MDl) between the standard vector x 

25 and the average vector u of the reference-pattern 

feature space. In a case where the standard vector and 
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the reference pattern have already been decided, the 
Mahalanobis distance may be calculated in advance and 
stored in a memory or the like. 

Fig. 32 is a conceptual view illustrating an 
5 example wherein a Mahalanobis distance (MD1) between the 
feature vector space of a reference pattern and a 
standard vector is obtained, and the feature vector of a 
document image (observation pattern) , in which watermark 
information is to be embedded, is altered in accordance 

10 with the watermark information. Numerals 11500 and 

11501 in Fig. 15 denote a standard vector and a feature 
vector of a reference pattern, respectively. Further, 
the feature vector of an observation pattern is 
indicated at 11502. 

15 Next, at step S82 in Fig. 30, the document image 

corresponding to the binary K-image data 104 of Fig. 1 
is read in. Control then proceeds to step S83, at which 
the document image that was read in at step S82 is 
divided into blocks, as shown in Fig. 16. Numerals 

20 1601, 1602 and 1603 in Fig. 16 denote a block of M x N 
pixels, a row-number index of each block and a column- 
number index of each block, respectively. The index 
number in Fig. 16 is an m X n matrix. An index vector 
of m x n dimensions corresponding to the blocks is 

25 generated based upon the index matrix. Element numbers 
of the index vector are the index numbers of the blocks 
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1601. 

Next, at step S84, random numbers from "1" to 
"m x n" are generated based upon key information 
decided in advance or entered by the user. The 
5 generated random numbers correspond to element numbers 
of the index vector generated at step S83. In other 
words, each random-number value corresponds to the index 
number of a block. 

This is followed by step S85, at which the bit 
10 sequence (8-bit data) of the access control information 
shown in Fig. 12 and the index number of each block are 
made to correspond. When this mapping reaches the end 
of the bit sequence (the eighth bit in the example of 
Fig. 12), the mapping of the next block starts from the 
15 beginning (the first bit) of this bit sequence. This 
bit sequence is thus assigned repeatedly until all 
blocks are assigned bits of the bit sequence. 

Fig. 17 illustrates an example of correspondence 
among the bit sequence 1701, which is watermark 
20 information, the random-number sequence 17 02 generated 
at step S8 4 and the index number of each block. 

Reference numerals 1701 and 1702 in Fig. 17 
represent the bit sequence and the random-number 
sequence corresponding thereto, respectively. The 
25 number of bits in the bit sequence 1701 and the number 
of random numbers (Rl to Rmn) , which are also the index 
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numbers of the respective blocks, are both m x n. 
Further, the random number Rl in Fig. 17 corresponds to 
the block of index number (I, J) = (1,1), the random 
number R2 corresponds to the block of index number (I, J) 
5 = (1,2) and, in similar fashion, the final random number 
Rmn corresponds to the block of index number (I, J) — 
(m, n) . 

Next, at step S8 6, it is determined whether random- 
number sequences up to the (m x n) th random-number 

10 sequence have been checked. If the (m x n) th random- 
number sequence has not yet been checked, control 
proceeds to step S87, at which the index number of the 
block [I, J = (1,1)] corresponding to the Xth (1 st ) random 
number (random number Rl in Fig. 17) of the random- 

15 number sequence 1702, as well as the value ("0" in the 

example of Fig. 17) of the bit of bit sequence 17 01 that 
corresponds to this index number, is acquired. Control 
then proceeds to step S88, at which the (M x N) -pixel 
block of the document image corresponding to the 

20 acquired index number is acquired. This is followed by 
step S89 (Fig. 31). This step is for calculating the 
Mahalanobis distance (MD2) between the feature space of 
an observation pattern when the obtained M x N document 
image is adopted as an observation image, and the 

25 standard vector. This is found on the basis of the 
following equation: 
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D2 = (x-p) " T^x-p) ... Eq. (6) 

where x represents the standard vector, p denotes the 
average vector of the observation-pattern feature space, 
Y," 1 denotes the inverse matrix of a covariance matrix of 
5 the reference-pattern feature space and D2 denotes the 
Mahalanobis distance (MD2) between the standard vector x 
and the average vector p of the observation-pattern 
feature space. 

Control then proceeds to step S90, at which it is 
10 determined whether the bit of the bit sequence 1701 that 
corresponds to this block is "0". If the bit is "0", 
control proceeds to step S91, at which the entire 
feature space of the observation pattern is moved so as 
to establish the following relation: 
15 MD1 > MD2 + defMD 

If the bit of bit sequence 1701 corresponding to 
this block is found to be "1" at step S90, control 
proceeds to step S93, at which the entire feature space 
of the observation pattern is moved so as to establish 
20 the following relation: 

MD1 < MD2 + defMD 

In Fig. 32, the feature vector of the observation 
pattern is indicated at 11502. Reference number 11503 
denotes the feature vector of the observation pattern 
25 moved at step S91 or S93. At the time of such movement, 
the shift is made in a direction in which there is an 
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increase in the values of the elements of all feature 
vectors in the feature space of the observation pattern; 
there is no movement in a direction in which the values 
of these elements decrease. 
5 Control proceeds from step S91 and S93 to step S92, 

at which the image data representing the observation 
image is reconstructed based upon the feature space of 
the observation pattern after the feature space of the 
observation pattern has been moved. The above is 

10 executed until random-number sequences no longer exist 

at step S86, i.e., until processing corresponding to the 
(m x n) th random number is completed. 

The binary K-image data thus obtained is output to 
the printer engine as the binary K-image data 104 of 

15 Fig. 1 and is printed by the printer. 

It should be noted that the hardware implementation 
of the image processing apparatus according to the third 
embodiment is identical with that of Fig. 1 and need not 
be described again. 

20 Described next will be a case where access control 

information (watermark information) is extracted from an 
image in which an electronic watermark has been embedded 
in the manner described above. 

Figs. 33 and 34 are flowcharts illustrating 

25 processing for extracting access control information 
from a printed image in accordance with the third 
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embodiment. The program for executing this processing 
has been stored in the memory 112 and is executed under 
the control of the CPU 111. 

In a manner similar to that of step S81 in Fig. 30 
5 described above, step S101 calls for the calculation of 
the Mahalanobis distance (MD1) between the reference- 
pattern feature space and the standard vector. Control 
then proceeds to step S102, at which the scanner of the 
image input unit 110 is used to read^ the printed image 

10 in a grayscale mode (8 bits/pixel) . This is followed by 
step S103, at which the outline of the read image is 
extracted and an outline image in which the outline 
portion is made a fine line of one pixel width, as shown 
in Fig. 4, for example, is generated. Next, at step 

15 S104, the outline image is converted to a size that 

prevailed when the access control information was added 
on. The outline image obtained by the conversion is 
then subjected to the processing set forth below. It 
should be noted that the processing of steps S105 to 

20 S110 in Figs. 33 and 34 is basically same as that of 
step S83, S84 and steps S86 to S89 in Figs. 30 and 31 
described above. At step S108, however, only the index 
number of the block corresponding to the Xth random 
number of the random-number sequence is extracted. This 

25 processing differs from that step S87. 
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More specifically, at step S105, the outline image 
is divided into (M x N) -pixel blocks and an m x n index 
matrix is generated from the row-number indices and 
column-number indices of the respective blocks, as shown 
5 in Fig. 31. An index vector of m x n dimensions is then 
generated from the index matrix. -The element numbers of 
the index vector are the index numbers of the respective 
blocks . 

Control then proceeds to step S106, at which 1 to 

10 m x n random numbers are generated based upon key 

information decided in advance or entered by the user. 
The generated random numbers correspond to the element 
numbers of the index vector generated at step S105. In 
other words, each random-number value corresponds to the 

15 index number of a block. Next, at step S107, it is 
determined whether a random-number sequence still 
exists, i.e., whether the processing of all blocks has 
been completed. If processing has not been completed 
for all blocks, control proceeds to step S108, at which 

2 0 the index number of the block corresponding to the Xth 

(1 st ) random number (random number Rl) is acquired. This 
is followed by step S109, at which the (M x N) -pixel 
outline image corresponding to the index number of the 
acquired block is obtained. Control then proceeds to 

25 step S110 (Fig. 34) . This step is for calculating the 
Mahalanobis distance (MD2) between the feature space of 
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an observation pattern when the obtained M x N document 
image is adopted as an observation image, and the 
standard vector. This can be found in accordance with 
Equation (6) cited above. 
5 Next, control proceeds to step Sill, at which the 

degree of similarity (g) between the Mahalanobis 
distance (MD1) and Mahalanobis distance (MD2) thus 
obtained is calculated. The degree of similarity (g) at 
this time is calculated in accordance with the following 
10 equation: 

g = MD1 - MD2 

Next, at step S112, the calculated similarity (g) 
and a predetermined value (defMD) are compared. If 
g > defMD holds, control proceeds to step S113 and it is 

15 decided that the embedded bit is "0". If it is found 

that g > defMD does not hold at step S112, then control 
proceeds to step S114, at which it is decided that the 
embedded bit is "1". Control returns to step S117 after 
step S113 or step S114 is executed. The processing of 

20 steps S108 to S114 is executed repeatedly until the 

above-described processing is applied to the (m x n) th 
random number. Thus, a number of decisions are rendered 
on the basis of the extracted bit sequence and the bit 
length that prevailed when the access control 

25 information was embedded is reconstructed. 
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Thus, in accordance with the third embodiment as 
described above, desired control information can be 
embedded without degrading the image that receives the 
embedded information. 
5 Further, control information that has been embedded 

in an image can be read and detected with high 
precision. 

[Fourth Embodiment] 

A fourth embodiment of the present invention will 

10 now be described. It should be noted that the hardware 
implementation of the fourth embodiment also is 
identical with that of the foregoing embodiments (Fig. 
18) and need not be described again. 

First, on the basis of the binary observation image 

15 comprising M x N pixels in Fig. 3, the outline of the 
binary observation image is extracted to obtain an 
outline image in which the outline is made a fine line 
of one pixel, as shown in Fig. 4. Fig. 5 described 
earlier is a diagram illustrating direction indices for 

2 0 extracting the features of a pixel of interest Pij in a 
case where the pixel of interest is located at the 
center of a 3 x 3 pixel block. Fig. 35 illustrates 
values corresponding to the features tl, t2, t3, t4, t5, 
t6, t7 and t8 of the direction indices of the pixel of 

25 interest shown in Fig. 5. In contradistinction to Fig. 
6, here a "0" indicates the presence of a pixel in the 
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direction of the corresponding direction index and a "1" 
the absence of a pixel in the direction of the 
corresponding direction index. 

Fig. 36 illustrates vectorization of the features 
5 (see Fig. 35) of the direction indices of the pixel of 
interest Pij shown in Fig. 5. Here the feature vector 
Hij of the direction indices is a vector of the features 
of the direction indices of the pixel of interest Pij . 
This vector has eight dimensions. 

10 The feature space of the observation pattern in 

this case is a set of feature vectors of direction 
indices for a case where each outline point of the 
outline images obtained in Fig. 4 is adopted as the 
pixel of interest of Fig. 5 in the binary observation 

15 image obtained in Fig. 3. Further, the feature space of 
the observation pattern has eight dimensions. The 
standard vector represents the features of the direction 
indices of the pattern shown in Fig. 8. 

Fig. 37 illustrates a vector DIST indicating the 

20 features of the direction indices of Fig. 8. This 

vector has eight dimensions. Here also "0" indicates 
the presence of a pixel in the particular direction and 
"1" the absence of a pixel in the particular direction. 
The feature space of a reference pattern in this 

25 case is a set of feature vectors of direction indices of 
each of the pixels in the outline image (see Fig. 11 of 
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the first embodiment) of the reference image (see Fig. 
10 of the first embodiment) of S x T pixels. 

It is assumed that the access control information 
(watermark information) in the fourth embodiment is 
5 identical with the data of Fig. 12 according to the 
foregoing embodiments. . - 

The feature space of an observation pattern, a 
standard vector and the feature space of a reference 
pattern relating to access control information in 

10 accordance with the fourth embodiment of the invention 
will now be described. 

Fig. 38 illustrates an example of an (M x N) -pixel 
multilevel grayscale observation image corresponding to 
part of the data 201 in Fig. 2. Fig. 39 is a diagram 

15 illustrating an outline image in which the outline of 

the multilevel grayscale observation image of Fig. 38 is 
extracted and made a fine line of one pixel. Fig. 4 0 is 
a diagram illustrating direction indices for extracting 
the features of the pixel of interest Pij in a case 

2 0 where the pixel of interest is located at the center of 
a 3 x 3 pixel block. Fig. 40 illustrates a case where 
"128", "150", "198", "255", "240", "255", "255" and "0" 
are the pixel values in the directions tl, t2, t3, t4, 
t5, t6, t7 and t8, respectively, of the pixel of 

25 interest. 

Fig. 41 illustrates pixel values corresponding to 
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the features tl, t2, t3, t4, t5, t6, t7 and t8 of the 
direction indices of the pixel of interest shown in Fig. 
40. Fig. 42 illustrates vectorization of the features 
of the direction indices of the pixel of interest Pij 
5 shown in Fig. 41. Here the feature vector Hij of the 
direction indices is a vector of the features of the 
direction indices of the pixel of interest Pij . This 
vector has eight dimensions. 

The feature space of the observation pattern is a 

10 set of feature vectors of direction indices for a case 
where each outline point of the outline images obtained 
in Fig. 39 is adopted as the pixel of interest of Fig. 5 
in the multilevel grayscale observation image obtained 
in Fig. 38. Further, the feature space of the 

15 observation pattern has eight dimensions. The standard 
vector represents the features of the direction indices 
of the pattern shown in Fig. 43. 

Fig. 44 illustrates a vector DIST of the features 
of the direction indices shown in Fig. 43. This vector 

2 0 has eight dimensions. 

The feature space of the reference pattern is a set 
of feature vectors of direction indices of each of the 
pixels in the outline image (see Fig. 11) of the 
reference image {see Fig. 10) of S x T pixels. It is 

25 assumed that the feature space of the reference pattern 
has eight dimensions. 
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A procedure for embedding access control 
information in a document image according to the fourth 
embodiment of the present invention will be illustrated 
next . 

5 Figs. 45 and 4 6 are flowcharts illustrating 

processing for embedding access control information in a 
document image according to the fourth embodiment. 

First, at step S121, the Mahalanobis distance (MD1 ) 
between the feature space of a reference pattern and a 

10 standard vector is calculated. This performed in 
accordance with the following equation: 

D2 = (x-u) ' E _1 (x-u) 
where x represents the standard vector, p denotes the 
average vector of the reference-pattern feature space, 

15 Y,' 1 denotes the inverse matrix of a covariance matrix of 
the reference-pattern feature space and D2 denotes the 
Mahalanobis distance (MD1) between the standard vector x 
and the average vector u of the reference-pattern 
feature space. 

20 Next, at step S122, the binary document image 

corresponding to data 104 of Fig. 1 is read in. Control 
then proceeds to step S123, at which the binary document 
image is divided into (M x N) -pixel blocks, as 
illustrated in Fig. 16. Numerals 1601, 1602 and 1603 in 

25 Fig. 16 denote a block of M x N pixels, a row-number 
index and a column-number index, respectively. The 
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index number in Fig. 16 is an m x n matrix. An index 
vector of m x n dimensions is generated from this index 
matrix. Element numbers of the index vector are the 
index numbers of the blocks. 
5 Next, at step S124, random numbers from "1" to 

"m x n" are generated based upon key information 
decided in advance or entered by the user. The 
generated random numbers correspond to element numbers 
of the index vector generated at step S123. In other 

10 words, each random-number value corresponds to the index 
number of a block. 

This is followed by step S125, at which the bit 
sequence (see Fig. 12) of the access control information 
(watermark information) and the index number of each 

15 block are made to correspond. When this mapping reaches 
the end of the bit sequence, the mapping of the next 
block starts from the beginning of this bit sequence. 
Next, at step S126, it is determined whether a random- 
number sequence still exists. If the answer is "YES", 

2 0 control proceeds to step S127. 

Fig. 17 is a diagram showing an example of 
correspondence among the bit sequence, random-number 
sequence and index number of each block. The number of 
random numbers of the bit sequence 1701 and the number 

25 of block index numbers constituting the random-number 
sequence are both m x n. 
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The index number of the block corresponding to the 
Xth (1 st ) random number, as well as the bit thereof, is 
acquired at step S127. This is followed by step S128, 
at which the M x N binary document image corresponding 
5 to the index number of the acquired block is obtained. 
Control then proceeds to step S123 (Fig. 4 6) . This step 
is for calculating the Mahalanobis distance (MD2) 
between the feature space of an observation pattern when 
the obtained M x N binary document image is adopted as 

10 an observation image, and the standard vector. This is 
found on the basis of the following equation: 

D2 = (x-p) ' S _1 (x-u) 
where x represents the standard vector, u denotes the 
average vector of the observation-pattern feature space, 

15 Y.' 1 denotes the inverse matrix of a covariance matrix of 
the observation-pattern feature space and D2 denotes the 
Mahalanobis distance (MD2) between the standard vector x 
and the average vector p of the observation-pattern 
feature space. 

20 Control then proceeds to step S130. If the bit of 

the access control information is "0", control proceeds 
to step S131, at which the entire feature space of the 
observation pattern is moved so as to establish the 
relation MD1 > MD2 + defMD. If the bit of the access 

25 control information is "1", on the other hand, control 

proceeds to step S132, at which the entire feature space 
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of the observation pattern is moved so as to establish 
the relation MD1 < MD2 + defMD. Here "defMD" represents 
a value set in advance . 

The movement of the entirety of feature space at 
5 step S131, S132 is made in a direction in which there is 
an increase in the values of the elements of all feature 
vectors in the feature space of the observation pattern; 
there is no movement in a direction in which the values 
of these elements decrease. 

10 Control proceeds from step S131 and S133 to step 

S133, at which the observation image is reconstructed 
based upon the feature space of the observation pattern 
after movement. Similar processing is executed up to 
the {m x n)th random number of the random- number 

15 sequence. 

The binary K-image data thus obtained is delivered 
to the printer engine as the binary K-image data 104 of 
Fig. 1 and is printed on a printing paper. 

Described next will be processing for extracting 

20 access control information (watermark information) from 
printed matter that has been printed following the 
embedding of the watermark information. 

Fig. 47 is a flowchart illustrating processing for 
extracting watermark information that has been embedded. 

25 First, step S141 calls for the calculation of the 

Mahalanobis distance (MD1) between the reference-pattern 
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feature space and the standard vector. This is found on 
the basis of the following equation: 

D2 = (x-u) ' S _1 (x-p) 
where x represents the standard vector, u denotes the 
5 average vector of the reference-pattern feature space, 
Y,' 1 denotes the inverse matrix of a covariance matrix of 
the reference-pattern feature space and D2 denotes the 
Mahalanobis distance (MDl) between the standard vector x 
and the average vector u of the reference-pattern 

10 feature space. 

Control then proceeds to step S142, at which the 
scanner is used to read the printed matter in a 
grayscale mode (8 bits/pixel) . This is followed by step 
S14 3, at which the multilevel grayscale image that has 

15 been read is converted to a size that prevailed when the 
access control information was added on. Next, at step 
S14 4, the outline is extracted and an outline image in 
which the outline portion is made a fine line of one 
pixel width is generated. 

20 More specifically, at step S143, the multilevel 

grayscale image resulting from the size conversion is 
divided into (M x N) -pixel blocks, as shown in Fig. 16. 
Numerals 1601, 1602 and 1603 in Fig. 16 denote a block 
of M x N pixels, a row-number index and a column-number 

25 index, respectively. The index number is an m x n 
matrix. An index vector of m x n dimensions is 
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generated from this index matrix. Element numbers of 
the index vector are the index numbers of the blocks. 
Next, at step S146, random numbers from "1" to 
"m x n" are generated based upon key information 
5 decided in advance or entered by the user. The 

generated random numbers correspond to element numbers 
of the index vector generated at step S145. In other 
words, each random-number value corresponds to the index 
number of a block. 

10 The index number of the block corresponding to the 

Xth (1 st ) random number is acquired at step S148. This 
is followed by step S149, at which the M x N outline 
image corresponding to the index number of the acquired 
block is obtained. Control then proceeds to step S150. 

15 This step is for calculating the Mahalanobis distance 
(MD2) between the feature space of an observation 
pattern and the standard vector. This is calculated 
from the obtained M x N outline image and the 
corresponding multilevel grayscale image following the 

20 size conversion. This is found on the basis of the 
following equation: 

D2 = (x-u) ' rMx-p) 
where x represents the standard vector, u denotes the 
average vector of the observation-pattern feature space, 

25 Y, 1 denotes the inverse matrix of a covariance matrix of 
the observation-pattern feature space and D2 denotes the 
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Mahalanobis distance (MD2) between the standard vector x 
and the average vector p of the observation-pattern 
feature space. 

Next, control proceeds to step S151, at which the 
5 degree of similarity (g) between the Mahalanobis 
distance (MD1) and Mahalanobis distance (MD2) thus 
obtained is calculated. The degree of similarity (g) at 
this time is calculated in accordance with the following 
equation: 

10 g = MD1 - MD2 

Next, at step S152, the calculated similarity (g) 
and "defMD" are compared. If g > defMD holds, control 
proceeds to step S153 and it is decided that the 
embedded bit is "0". If it is found that g > defMD does 

15 not hold, on the other hand, then control proceeds to 

step S154, at which it is decided that the embedded bit 
is "1". It should be noted that "defMD" is a value set 
in advance. Similar processing is executed until the 
final random-number sequence, i.e., the (m x n)th, is 

20 detected at step S147. Thus, a number of decisions are 
rendered on the basis of the extracted bit sequence and 
the bit length that prevailed when the access control 
information was embedded is reconstructed. 

The present invention can be applied to a system 

25 constituted by a plurality of devices (e.g., a host 
computer, interface, reader, printer, etc.) or to an 
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apparatus comprising a single device (e.g., a copier or 
facsimile machine, etc.). 

Furthermore, it goes without saying that the object 
of the invention is attained also by supplying a storage 
5 medium storing the program codes of the software for 

performing the functions of the foregoing embodiments to 
a system or an apparatus, reading the program codes with 
a computer (e.g., a CPU or MPU) of the system or 
apparatus from the storage medium, and then executing 

10 the program codes. In this case, the program codes read 
from the storage medium implement the novel functions of 
the embodiments and the storage medium storing the 
program codes constitutes the invention. Furthermore, 
besides the case where the aforesaid functions according 

15 to the embodiments are implemented by executing the 

program codes read by a computer, it goes without saying 
that the present invention covers a case where an 
operating system or the like running on the computer 
performs a part of or the entire process in accordance 

20 with the designation of program codes and implements the 
functions according to the embodiment. 

It goes without saying that the present invention 
further covers a case where, after the program codes 
read from the storage medium are written in a function 

25 expansion card inserted into the computer or in a memory 
provided in a function expansion unit connected to the 
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computer, a CPU or the like contained in the function 
expansion card or function expansion unit performs a 
part of or the entire process in accordance with the 
designation of program codes and implements the 
5 functions of the above embodiments. 

Further, through the embodiments have been 
described independently of one another, this does not 
impose a limitation upon the present invention, which 
also covers cases where the foregoing embodiments are 

10 implemented in upon being suitable combined. 

The present invention is not limited to the above 
embodiments and various changes and modifications can be 
made within the spirit and scope of the present 
invention. Therefore, to apprise the public of the 

15 scope of the present invention, the following claims are 
made . 
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WHAT IS CLAIMED IS: 

1. An image processing apparatus comprising: 
image input means for inputting an image; 
extraction means for extracting an outline of the 
5 image that has been input by said image input means; 
vector generating means for generating vector 
information conforming to state of pixels neighboring 
each pixel constituting the output that has been 
extracted by said extraction means; and. 
10 embedding means for altering the image in 

accordance with watermark information and embedding the 
watermark information on the basis of the vector 
information . 



15 2. The apparatus according to claim 1, wherein the 
vector information is 8-dimension vector information 
indicating whether there are eight pixels neighboring a 
pixel of interest. 



20 3. An image processing method comprising: 

an image input step of inputting an image; 
an extraction step of extracting an outline of the 
image that has been input at said image input step; 
a vector generating step of generating vector 
25 information conforming to state of pixels neighboring 
each pixel constituting the output that has been 
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extracted at said extraction step; and 

an embedding step of altering the image in 
accordance with watermark information and embedding the 
watermark information on the basis of the vector 
information. 

4. The method according to claim 3, wherein the vector 
information is 8 -dimension vector information indicating 
whether there are eight pixels neighboring a pixel of 
interest . 

5. An image processing apparatus for processing a 
binary image input thereto, comprising: 

arithmetic means for obtaining an average of 
pattern scores of a target binary image based upon the 
target binary image and first principal component values 
of a reference pattern; 

comparison means for comparing the average of 
pattern scores of the target binary image and a 
reference-pattern score that is based upon a sum total 
of distances between a first principal component 
direction of the reference pattern and a standard 
vector; 

translation means for translating feature vector 
space of the target binary image in accordance with 
result of the comparison by said comparison means and 
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access control information to be embedded in the target 
binary image; and 

altering means for altering the target binary image 
based upon a result obtained by translating the feature 
5 vector space. 

6. The apparatus according to claim 5, wherein the 
average of pattern scores of the target binary image is 
obtained based upon the following equation: 

10 zzl* = (allul* + al2u2* + al3u3* + al4u4* + al5u5* + 

al6u6* + al7u7* + al8u8*)/p; 

where all, al8 represent first principle 

components of the reference pattern, ul*, u8* 

represent component values of pattern feature space of a 
15 standardized binary image, and p represents a number of 

pixels in the pattern feature space of the binary image. 

7. The apparatus according to claim 5, wherein said 
translation means translates the feature vector space in 

20 a direction in which there is an increase in the value 
of each element of the feature vector of the target 
binary image. 

8. The apparatus according to claim 5, wherein the 
25 reference-pattern score is obtained based upon the 

following equation: 
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zl* = allxl* + al2x2* + al3x3* + al4x4* + al5x5* + 
al6x6* + al7x7* + al8x8*; 

where all, al8 represent first principle 

components of the reference pattern and xl*, • • • , x8* 
5 represent component values of a standardized standard 
vector. 

9. The apparatus according to claim 5, wherein the 
pattern feature space is a set of vector information 

10 indicating whether each pixel in an outline image of the 
target binary image has a neighboring pixel. 

10. The apparatus according to claim 5, wherein said 
translation means translates the feature vector space in 

15 such a manner that the average of pattern scores of the 
target binary image will exceed the reference-pattern 
score by a predetermined amount when a logic value of 
the access control information is "0", and translates 
the feature vector space in such a manner that the sum 

20 of the reference-pattern score and the predetermined 

amount will exceed the average of pattern scores of the 
target binary image when a logic value of the access 
control information is "1". 

25 11. The apparatus according to claim 5, further 

comprising printing means for printing based upon image 



- 62 - 



data corresponding to the target binary image that has 
been altered by said altering means. 



12. The apparatus according to claim 5, further 
5 comprising: 

extraction means for reading a document image 
formed based upon the target binary image that has been 
altered by said altering means, and extracting an 
outline of this image; 
10 means for obtaining an average of pattern scores of 

an image that corresponds to the outline; 

difference calculation means for obtaining a 
difference between the reference-pattern score, which is 
based upon a sum total of distances between the first 
15 principle component direction of the reference pattern 
and the standard vector, and the average of pattern 
scores; and 

detection means for detecting control information, 
which has been embedded in the document image, in 
20 accordance with the difference obtained by said 
difference calculation means. 



13. An image processing apparatus comprising: 

extraction means for reading a document image and 
25 extracting an outline of the image; 

means for obtaining an average of pattern scores of 
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an image that corresponds to the outline; 

difference calculation means for obtaining a 
difference between a reference-pattern score, which is 
based upon a sum total of distances between a first 
5 principal component direction of a reference pattern and 
the standard vector, and the average Qf pattern scores; 
and 

detection means for detecting control information, 
which has been embedded in the document image, in 
10 accordance with the difference obtained by said 
difference calculation means. 



14. An image processing apparatus for processing a 

binary image input thereto, comprising: 
15 calculation means for calculating a pattern vector 

of a target binary image; 

arithmetic means for calculating a correlation 

coefficient r between the pattern vector calculated by 

said calculation means and a reference-pattern vector; 
20 input means for inputting access control 

information to be embedded in the target binary image; 
moving means for moving feature space of the 

pattern vector in accordance with the access control 

information, which has been input by said input means, 
25 in such a manner that the correlation coefficient r that 

has been calculated by said arithmetic means will fall 
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within a predetermined range; and 

altering means for altering the target binary image 
based upon a result obtained by moving the vector space 
of the feature quantity. 

5 

15. The apparatus according to claim 14, wherein said 
calculation means includes: 

outline extraction means for extracting an outline 
of the target binary image; and 
10 dividing means for dividing the outline, which has 

been extracted by said outline extraction means, into a 
plurality of blocks; 

said calculation means calculating a pattern vector 
of each of the plurality of blocks. 

15 

16. The apparatus according to claim 15, wherein said 
moving means assigns each bit of the access control 
information, which has been input by said input means, 
to each block obtained by division by said dividing 

2 0 means, and moves the feature vector space in such a 

manner that the correlation coefficient r will satisfy 
the relation -def < r < def when the particular bit is 
"0" and in such a manner that the correlation 
coefficient r will satisfy the relation -1 ^ r < -def 

25 or def < r ^ 1 when the particular bit is "1". 
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17. The apparatus according to claim 14, wherein said 
moving means moves the feature vector space in a 
direction in which there is an increase in the value of 
each element of the feature vector of the target binary 

5 image . 

18. The apparatus according to claim 14, wherein the 
feature space is a set of vector information indicating 
whether each pixel in an outline image of the target 

10 binary image has a neighboring pixel. 

19. The apparatus according to claim 14, further 
comprising printing means for printing based upon image 
data corresponding to the target binary image that has 

15 been altered by said altering means. 

20. The apparatus according to claim 14, further 
comprising : 

extraction means for reading a document image 
2 0 formed based upon the target binary image that has been 
altered by said altering means, and extracting an 
outline of this image; 

means for obtaining a pattern vector of an image 
that corresponds to the outline; and 
25 detection means for detecting the access control 

information, which has been embedded in the document 
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image, in accordance with the correlation coefficient r, 
which has been calculated by said arithmetic means, 
between the pattern vector and the reference-pattern 
vector . 

5 

21. An image processing apparatus comprising: 

extraction means for reading a document image and 

extracting an outline of the image; 

means for obtaining a pattern vector of an image 
10 that corresponds to the outline; 

correlation-coefficient arithmetic means for 

obtaining a correlation coefficient between a pattern 

vector of a reference pattern and the pattern vector of 

the image ; and 

15 detection means for detecting control information, 

which has been embedded in the document image, in 
accordance with the correlation coefficient obtained by 
said correlation-coefficient arithmetic means. 

2 0 22. An image processing apparatus for processing a 

binary image input thereto, comprising: 

arithmetic means for obtaining a first Mahalanobis 

distance between feature space of a target binary image 

and a standard vector; 
2 5 comparison means for comparing the Mahalanobis 

distance of the target binary image and a second 
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Mahalanobis distance between feature space of a 

reference pattern and the standard vectors- 
translation means for translating a feature vector 

space of the target binary image in accordance with 
5 result of the comparison by said comparison means and 

access control information to be embedded in the target 

binary image; and 

altering means for altering the target binary image 

based upon a result obtained by translating the feature 
10 vector space. 

23. The apparatus according to claim 22, wherein the 
first Mahalanobis distance between the target binary 
image and standard vector is obtained based upon the 
15 following equation: 

D2 = (x-p) ' S _1 (x-p) 

where x represents the standard vector, u denotes 
an average vector of the reference-pattern feature 
space, X -1 denotes an inverse matrix of a covariance 
20 matrix of the reference-pattern feature space and D2 
denotes the Mahalanobis distance between the standard 
vector x and the average vector u of the reference- 
pattern feature space. 

25 24. The apparatus according to claim 22, wherein said 

translation means translates the feature vector space in 



- 68 - 



a direction in which there is an increase in the value 
of each element of the feature vector of the target 
binary image. 



5 25. The apparatus according to claim 22, wherein the 
second Mahalanobis distance between the reference- 
pattern feature space and the standard vector is 
obtained based upon the following equation: 
D2 = (x-u) " IT'Cx-u) 

10 where x represents the standard vector, u denotes 

an average vector of an observation-pattern feature 
space, 2" 1 denotes an inverse matrix of a covariance 
matrix of the observation-pattern feature space and D2 
denotes the Mahalanobis distance between the standard 

15 vector x and the average vector u of the observation- 
pattern feature space. 

26. The apparatus according to claim 22, wherein the 
pattern feature space is a set of vector information 

20 indicating whether each pixel in an outline image of the 
target binary image has a neighboring pixel. 

27. The apparatus according to claim 22, wherein said 
translation means translates the feature vector space in 

25 such a manner that the first Mahalanobis distance will 
exceed the second Mahalanobis distance by a 
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predetermined amount when a logic value of the access 
control information is "0", and translates the feature 
vector space in such a manner that the first Mahalanobis 
distance will be less than the sum of the second 
5 Mahalanobis distance and the predetermined amount when a 
logic value of the access control information is "1". 

28. The apparatus according to claim 22, further 
comprising printing means for printing based upon image 

10 data corresponding to the target binary image that has 
been altered by said altering means. 

29. The apparatus according to claim 22, further 
comprising : 

15 extraction means for reading a document image 

formed based upon the target binary image that has been 

altered by said altering means, and extracting an 

outline of this image; 

distance calculation means for obtaining the 
2 0 Mahalanobis distance between pattern feature space of 

the image that corresponds to the outline, and the 

standard vector; and 

detection means for detecting the access control 

information, which has been embedded in the document 
25 image, in accordance with the Mahalanobis distance, 

which has been obtained by said distance calculation 
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means, and the first Mahalanobis distance. 

30. An image processing apparatus comprising: 
extraction means for reading a document image and 

5 extracting an outline of the image; 

first distance calculation means for obtaining a 
first Mahalanobis distance between feature space of an 
image, which corresponds to the outline, and a standard 
vector; 

10 second distance calculation means for obtaining a second 
Mahalanobis distance between a reference-pattern feature 
space and the standard vector; 

difference calculation means for obtaining the 
difference between the first and second Mahalanobis 

15 distances; and 

detection means for detecting control information, 
which has been embedded in the document image, in 
accordance with the difference obtained by said 
difference calculation means. 

20 

31. An image processing method for processing an input 
binary image, comprising: 

an arithmetic step of obtaining an average of 
pattern scores of a target binary image based upon the 
2 5 target binary image and first principal component values 
of a reference pattern; 
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a comparison step of comparing the average of 
pattern scores of the target binary image and a 
reference-pattern score that is based upon a sum total 
of distances between a first principal component 
5 direction of the reference pattern and a standard 
vector; , _ 

a translation step of translating feature vector 
space of the target binary image in accordance with 
result of the comparison at said comparison step and 
10 access control information to be embedded in the target 
binary image; and 

an altering step of altering the target binary 
image based upon a result obtained by translating the 
feature vector space. 

15 

32. The method according to claim 31, wherein the 
average of pattern scores of the target binary image is 
obtained based upon the following equation: 
zzl* = (allul* + al2p2* + al3p3* + al4p4* + al5p5* + 

20 al6p6* + al7p7* + al8p8*)/p; 

where all, al8 represent first principle 

components of the reference pattern, pi*, p8* 
represent component values of pattern feature space of a 
standardized binary image, and p represents a number of 

25 pixels in the pattern feature space of the binary image. 
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33. The method according to claim 31, wherein said 
translation step translates the feature vector space in 
a direction in which there is an increase in the value 
of each element of the feature vector of the target 

5 binary image. 

34. The method according to claim 31, wherein the 
reference-pattern score is obtained based upon the 
following equation: 

10 zl* = allxl* + al2x2* + al3x3* + al4x4* + al5x5* + 

al6x6* + al7x7* + al8x8*; 

where all, al8 represent first principle 

components of the reference pattern and xl*, • • • , x8* 
represent component values of a standardized standard 
15 vector. 

35. The method according to claim 31, wherein the 
pattern feature space is a set of vector information 
indicating whether each pixel in an outline image of the 

20 target binary image has a neighboring pixel. 

36. The method according to claim 31, wherein said 
translation step translates the feature vector space in 
such a manner that the average of pattern scores of the 

25 target binary image will exceed the reference-pattern 
score by a predetermined amount when a logic value of 
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the access control information is "0", and translates 
the feature vector space in such a manner that the sum 
of the reference-pattern score and the predetermined 
amount will exceed the average of pattern scores of the 
5 target binary image when a logic value of the access 
control information is "1". 

37. The method according to claim 5, further comprising 
printing means for printing based upon image data 

10 corresponding to the target binary image that has been 
altered by said altering means. 

38. The method according to claim 31, further 
comprising : 

15 an extraction step of reading a document image 

formed based upon the target binary image that has been 
altered at said altering step, and extracting an outline 
of this image; 

a step of obtaining an average of pattern scores of 

2 0 an image that corresponds to the outline; 

a difference calculation step of obtaining a 
difference between the reference-pattern score, which is 
based upon a sum total of distances between the first 
principle component direction of the reference pattern 

25 and the standard vector, and the average of pattern 
scores; and 



- 74 - 



a detection step of detecting control information, 
which has been embedded in the document image, in 
accordance with the difference obtained by said 
difference calculation step. 

5 

39. An image processing method comprising: 

an extraction step of reading a document image and 
extracting an outline of the image; 

a step of obtaining an average of pattern scores of 
10 an image that corresponds to the outline; 

a difference calculation step of obtaining a 
difference between a reference-pattern score, which is 
based upon a sum total of distances between a first 
principal component direction of a reference pattern and 
15 the standard vector, and the average of pattern scores; 
and 

a detection step of detecting control information, 
which has been embedded in the document image, in 
accordance with the difference obtained at said 
20 difference calculation step. 



40. An image processing method for processing an input 
binary image, comprising: 

a calculation step of calculating a pattern vector 
25 of a target binary image; 

an arithmetic step of calculating a correlation 
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coefficient r between the pattern vector calculated at 
said calculation step and a reference-pattern vector; 

an input step of inputting access control 
information to be embedded in the target binary image; 
5 a moving step of moving feature space of the 

pattern vector in accordance with the access control 
information, which has been input at said input step, in 
such a manner that the correlation coefficient r that 
has been calculated at said arithmetic step will fall 
10 within a predetermined range; and 

an altering step of altering the target binary 
image based upon a result obtained by moving the vector 
space of the feature quantity. 

15 41. The method according to claim 40, wherein said 
calculation step includes: 

an outline extraction step of extracting an outline 
of the target binary image; and 

a dividing step of dividing the outline, which has 
20 been extracted at said outline extraction step, into a 
plurality of blocks; 

said calculation step calculating a pattern vector 
of each of the plurality of blocks. 

25 42. The method according to claim 40, wherein said 
moving step assigns each bit of the access control 



- 76 - 



1 



information, which has been input at said input step, to 
each block obtained by division at said dividing step, 
and moves the feature vector space in such a manner that 
the correlation coefficient r will satisfy the relation 
5 -def < r < def when the particular bit is "0" and in 
such a manner that the correlation coefficient r will 
satisfy the relation -1 < r < -def or def < r < 1 when 
the particular bit is "1". 

10 43. The method according to claim 40, wherein said 
moving step moves the feature vector space in a 
direction in which there is an increase in the value of 
each element of the feature vector of the target binary 
image . 

15 

44. The method according to claim 40, wherein the 
feature space is a set of vector information indicating 
whether each pixel in an outline image of the target 
binary image has a neighboring pixel. 

20 

45. The method according to claim 40, further 
comprising a printing step of printing based upon image 
data corresponding to the target binary image that has 
been altered at said altering step. 

25 

46. The method according to claim 40, further 
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comprising : 

an extraction step of reading a document image 
formed based upon the target binary image that has been 
altered at said altering step, and extracting an outline 
5 of this image ; 

a step of obtaining a pattern vector of an image 
that corresponds to the outline; and 

a detection step of detecting the access control 
information, which has been embedded in the document 
10 image, in accordance with the correlation coefficient r, 
which has been calculated at said arithmetic step, 
between the pattern vector and the reference-pattern 
vector . 



15 47. An image processing method comprising: 

an extraction step of reading a document image and 
extracting an outline of the image; 

a step of obtaining a pattern vector of an image 
that corresponds to the outline; 
20 a correlation-coefficient arithmetic step of 

obtaining a correlation coefficient between a pattern 
vector of a reference pattern and the pattern vector of 
the image ; and 

a detection step of detecting control information, 
25 which has been embedded in the document image, in 

accordance with the correlation coefficient obtained at 
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said correlation-coefficient arithmetic step. 

48. An image processing method for processing an input 
binary image, comprising: 

5 an arithmetic step of obtaining a first Mahalanobis 

distance between feature space of a target binary image 
and a standard vector; 

a comparison step of comparing the Mahalanobis 
distance of the target binary image and a second 
10 Mahalanobis distance between feature space of a 
reference pattern and the standard vector; 

a translation step of translating a feature vector 
space of the target binary image in accordance with 
result of the comparison at said comparison step and 
15 access control information to be embedded in the target 
binary image; and 

an altering step of altering the target binary 
image based upon a result obtained by translating the 
feature vector space. 

20 

49. The method according to claim 48, wherein the first 
Mahalanobis distance between the target binary image and 
standard vector is obtained based upon the following 
equation : 

25 D2 = (x-u) ' E _1 (x-u) 

where x represents the standard vector, u denotes 
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an average vector of the reference-pattern feature 
space, Y,' 1 denotes an inverse matrix of a covariance 
matrix of the reference-pattern feature space and D2 
denotes the Mahalanobis distance between the standard 
5 vector x and the average vector u of the reference- 
pattern feature space. 

50. The method according to claim 48, wherein said 
translation step translates the feature vector space in 

10 a direction in which there is an increase in the value 
of each element of the feature vector of the target 
binary image. 

51. The method according to claim 48, wherein the 
15 second Mahalanobis distance between the reference- 
pattern feature space and the standard vector is 
obtained based upon the following equation: 

D2 = (x-u)" £ -1 (x-u) 

where x represents the standard vector, u denotes 
20 an average vector of an observation-pattern feature 
space, denotes an inverse matrix of a covariance 

matrix of the observation-pattern feature space and D2 
denotes the Mahalanobis distance between the standard 
vector x and the average vector p of the observation- 
25 pattern feature space. 
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52. The method according to claim 48, wherein the 
pattern feature space is a set of vector information 
indicating whether each pixel in an outline image of the 
target binary image has a neighboring pixel. 

5 

53. The method according to claim 48, wherein said 
translation step translates the feature vector space in 
such a manner that the first Mahalanobis distance will 
exceed the second Mahalanobis distance by a 

10 predetermined amount when a logic value of the access 
control information is "0", and translates the feature 
vector space in such a manner that the first Mahalanobis 
distance will be less than the sum of the second 
Mahalanobis distance and the predetermined amount when a 

15 logic value of the access control information is "1". 

54. The method according to claim 48, further 
comprising a printing step of printing based upon image 
data corresponding to the target binary image that has 

20 been altered at said altering step. 

55. The method according to claim 48, further 
comprising : 

an extraction step of reading a document image 
25 formed based upon the target binary image that has been 
altered at said altering step, and extracting an outline 
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of this image; 

a distance calculation step of obtaining the 
Mahalanobis distance between pattern feature space of 
the image that corresponds to the outline, and the 
5 standard vector; and 

a detection step of detecting the access control 
information, which has been embedded in the document 
image, in accordance with the Mahalanobis distance, 
which has been obtained at said distance calculation 
10 step, and the first Mahalanobis distance. 

56. An image processing method comprising: 

an extraction step of reading a document image and 
extracting an outline of the image; 
15 a first distance calculation step of obtaining a 

first Mahalanobis distance between feature space of an 
image, which corresponds to the outline, and a standard 
vector; 

a second distance calculation step of obtaining a 
20 second Mahalanobis distance between a reference-pattern 
feature space and the standard vector; 

a difference calculation step of obtaining the 
difference between the first and second Mahalanobis 
distances; and 

25 a detection step of detecting control information, 

which has been embedded in the document image, in 
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accordance with the difference obtained at said 
difference calculation step. 

57. A computer-readable storage medium storing a 
5 program for executing an image processing method for 
processing an input binary image, said storage medium 
comprising: 

a module for an arithmetic step of obtaining an 
average of pattern scores of a target binary image based 
10 upon the target binary image and first principal 
component values of a reference pattern; 

a module for a comparison step of comparing the 
average of pattern scores of the target binary image and 
a reference-pattern score that is based upon a sum total 
15 of distances between a first principal component 
direction of the reference pattern and a standard 
vector; 

a module for a translation step of translating 
feature vector space of the target binary image in 
2 0 accordance with result of the comparison by the module 
for said comparison step and access control information 
to be embedded in the target binary image; and 

a module for an altering step of altering the 
target binary image based upon a result obtained by 
25 translating the feature vector space. 
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58. A computer-readable storage medium storing a 
program for executing an image processing method for 
processing an input image, said storage medium 
comprising: 

5 a module for an extraction step of reading a 

document image and extracting an outline of the image; 

a module for a step of obtaining an average of 
pattern scores of an image that corresponds to the 
outline; 

10 a module for a difference calculation step of 

obtaining a difference between a reference-pattern 
score, which is based upon a sum total of distances 
between a first principal component direction of a 
reference pattern and the standard vector, and the 

15 average of pattern scores; and 

a module for a detection step of detecting control 
information, which has been embedded in the document 
image, in accordance with the difference obtained by the 
module for said difference calculation step. 

20 

59. A computer-readable storage medium storing a 
program for executing an image processing method for 
processing an input binary image, said storage medium 
comprising : 

25 a module for a calculation step of calculating a 

pattern vector of a target binary image; 
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a module for an arithmetic step of calculating a 
correlation coefficient between the pattern vector 
calculated at said calculation step and a reference- 
pattern vector; 

a module for an input step of inputting access 
control information to be embedded in the target binary 
image ; 

a module for a moving step of moving feature space 
of the pattern vector in accordance with the access 
control information, which has been input by the module 
for said input step, in such a manner that the 
correlation coefficient that has been calculated by the 
module for said arithmetic step will fall within a 
predetermined range; and 

a module for an altering step of altering the 
target binary image based upon a result obtained by 
moving the vector space of the feature quantity. 

60. A computer-readable storage medium storing a 
program for executing an image processing method for 
processing an input image, said storage medium 
comprising: 

a module for an extraction step of reading a 
document image and extracting an outline of the image; 

a module for a step of obtaining a pattern vector 
of an image that corresponds to the outline; 



a module for a correlation-coefficient arithmetic 
step of obtaining a correlation coefficient between a 
pattern vector of a reference pattern and the pattern 
vector of the image; and 
5 a module for a detection step of detecting control 

information, which has been embedded in the document 
image, in accordance with the correlation coefficient 
obtained by the module for said correlation-coefficient 
arithmetic step. 

10 

61. A computer-readable storage medium storing a 
program for executing an image processing method for 
processing an input binary image, said storage medium 
comprising : 

15 a module for an arithmetic step of obtaining a 

first Mahalanobis distance between feature space of a 
target binary image and a standard vector; 

a module for a comparison step of comparing the 
Mahalanobis distance of the target binary image and a 

20 second Mahalanobis distance between feature space of a 
reference pattern and the standard vector; 

a module for a translation step of translating a 
feature vector space of the target binary image in 
accordance with result of the comparison by the module 

25 for said comparison step and access control information 
to be embedded in the target binary image; and 
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a module for an altering step of altering the 
target binary image based upon a result obtained by 
translating the feature vector space. 

5 62. A computer-readable storage medium storing a 

program for executing an image processing method for 
processing an input image, said storage medium 
comprising: 

a module for an extraction step of reading a 
10 document image and extracting an outline of the image; 

a module for a first distance calculation step of 
obtaining a first Mahalanobis distance between feature 
space of an image, which corresponds to the outline, and 
a standard vector; 
15 a module for a second distance calculation step of 

obtaining a second Mahalanobis distance between a 
reference-pattern feature space and the standard vector; 

a module for a difference calculation step of 
obtaining the difference between the first and second 
20 Mahalanobis distances; and 

a module for a detection step of detecting control 
information, which has been embedded in the document 
image, in accordance with the difference obtained by the 
module for said difference calculation step. 

25 

63. A computer-readable storage medium storing a 
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program for executing an image processing method for 
processing an input image, said storage medium 
comprising: 

a module for an image input step of inputting an 
5 image ; 

a module for an extraction step of extracting an 
outline of the image that has been input by the module 
for said image input step; 

a module for a vector generating step of generating 
10 vector information conforming to state of pixels 

neighboring each pixel constituting the output that has 
been extracted by the module for said extraction step; 
and 

a module for an embedding step of altering the 
15 image in accordance with watermark information and 

embedding the watermark information on the basis of the 
vector information. 
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ABSTRACT OF THE DISCLOSURE 



An average of pattern scores of a target binary 
image is obtained based upon the target binary image and 
5 first principal component vectors of a reference 

pattern, and the average of pattern scores of the target 
binary image is compared with a reference-pattern score 
that is based upon a sum total of distances between the 
first principal component direction of the reference 

10 pattern and a standard vector. Feature vector space of 
the target binary image is translated in accordance with 
the result of the comparison and access control 
information to be embedded in the target binary image, 
and an image is formed upon altering the target binary 

15 image based upon the result obtained by translating the 
feature vector space. 
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